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Abstract 



Let X = (Xi,X2, ...) be a non-deterministic infinite exchangeable sequence with values in {0, 1}. 
We show that X is Hoeffding-decomposable if, and only if, X is either an i.i.d. sequence or a Polya 
sequence. This completes the results established in Peccati [2004]. The proof uses several combinato- 
rial implications of the correspondence between Hoeffding decomposability and weak independence. 
Our results must be compared with previous characterizations of i.i.d. and Polya sequences given by 
Hill et al. [1987] and Diaconis and Yilvisaker [1979] . 
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1 Introduction, notation and statements 

Let Xfx oo) = {X n : n > 1} be an exchangeable sequence of random observations, with values in some 
finite set D. We say that X[i )00 ) is Hoeffding decomposable if, for every n > 2, every symmetric statistic 
T (Xi, X„) admits a unique representation as an orthogonal sum of uncorrelated [/-statistics with 
degenerate kernels of increasing order. Hoeffding decompositions (also known as ANOVA decompositions) 
have been extensively studied for i.i.d. sequences (see for instance Hoeffding [1948], Hajek [1968], Karlin 
and Rinott [1982], Vitale [1991] and Bentkus et al. [1997]) and for extractions without replacement from 
a finite population (see Zhao and Chen [1990], Bloznelis and Gotze [2001, 2002] and Bloznelis [2005]). 
In Peccati [2003, 2004, 2005], the second author of this paper has extended the theory of Hoeffding 
decompositions to the framework of general exchangeable random sequences. In particular, it was shown 
therein that the class of Hoeffding decomposable exchangeable sequences coincides with the collection of 
weakly independent sequences. 

The aim of this note is to complete the results established in Peccati [2004] by proving that a (non 
deterministic) infinite exchangeable sequence with values in {0, 1} is Hoeffding decomposable if, and only 
if, it is either a Polya sequence or i.i.d.. As shown in Section^ this result links the seemingly unrelated 
notions of Hoeffding decomposable sequence and urn process, a concept studied e.g. in Hill et al. [1987]. 

Before stating our main theorem, we recall some basic definitions and facts concerning Hoeffding 
decompositions and exchangeable sequences. We focus on sequences with values in a finite set. The reader 
is referred to Peccati [2004] for any unexplained concept or notation, as well as for general statements 
concerning sequences with values in arbitrary Polish spaces. 

* E-mail: omar.eldakkak@gmail.com 
t E-mail: giovanni.peccati@gmail.com 
■''175, rue du Chevaleret, 75013 Paris, France. 
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1.1 Preliminaries 

Let D be a finite set, and consider an infinite exchangeable sequence X[ lj00 ) = {X n : n > 1} of D- 
valued random variables, defined on some probability space (O, «F,P) such that T = cr(Xr li00 )). We 
recall that, according to the well-known de Finetti Theorem (see e.g. Aldous [1983]), the assumption of 
exchangeability implies that Xn jO0 ) is necessarily a mixture of i.i.d. sequences with values in D. 

For every n > 1 and every 1 < u < n, we write [n] = {1, ...,n} and [u,n] = {u,u + 1, and set 

x [u,n] - (X u ,X u+1 ...,X n ) and X[„] = X [Ml] = (X 1 ,X 2 , —,X n ). For every n > 2, we define the sequence 
of spaces 

{SU k (X [n] ) :k = 0,. ..,»}, 

generated by symmetric [/-statistics of increasing order, as follows: 5t/o (Xr„i) = 5ft and, for fc = 1, n, 
SUk (X[„]j is the collection of all random variables of the type 

^( x n)= E r(x h ,...,x jh ), (l) 

l<ii<...<i*<n 

where <£> is a real-valued symmetric function from D k to K. A random variable such as F in is called 
a U-statistic with symmetric kernel of order k. It is easily seen that the kernel ip appearing in Q is 
unique, in the sense that if ip 1 is another symmetric kernel satisfying l(TJl. then ip (Xj^jj = (X[fe]J, a.s.-P. 
The following facts are immediately checked: (i) for every k — 0, ...,n, SUk ( x [n]) is a vector space, (ii) 
SUk-i (X[„]) C SU k ( x [n]), (hi) Sf/n (X[ n j) = L s (X [n] ), where (for n > 1) L s (X[ n] ) is defined as the 
set of all random variables of the type T (X[„]) = T (Xx, ...,X n ), where T is a symmetric function from 
D n to K. The class of all symmetric functions, from D n to 3J, will be denoted by S(D n ). Note that 
L s (Xr„i) is a Hilbert space with respect to the inner product (Ti,T 2 ) = E [Ti (X[„]) T 2 (Xr n i)l , so that 
each SUk ( x [„]) is a closed subspace of L s (Xy). Finally, the sequence of symmetric Hoeffding spaces 
{SHk (X[ n ]J : fc = 0, associated to X[„] is defined as SH n (X[„j) = SUo (X[ n j) = 5R, and 

SH k (X [n] ) 4 5f/ fc (X w ) n Sl7 fc _i (X [n] ) X , fc = 1, ...,n, (2) 

where all orthogonals (here and in the sequel) are taken in L s (Xr„ij. Observe that SHf. (Xr n iJ C 
Sf/fe (X[ n j) for every k, so that each F £ (X[ n j) has necessarily the form (QJ for some well-chosen sym- 
metric kernel (p. Moreover, since SU n (Xr„iJ = L s (Xu), one has the following orthogonal decomposition: 

n 

L s (X w )=0Sff t (X w ), (3) 

fc=0 

where " © " stands for an orthogonal sum. In particular, implies that every symmetric random 
variable T (Xr n i) G L s (Xr n ]J admits a unique representation as a non-correlated sum of n + 1 terms, 
with the kth summand (k = 0, ...,n) equal to an element of SHk (X[„j). 

The next definition, which is essentially borrowed from Peccati [2004], formalizes the notion of "Ho- 
effding decomposability" evoked at the beginning of the section. 

Definition A. The random sequence X[ 1)SO j is Hoeffding decomposable if, for every n > 2 and every 
k = 1, n, the following double implication holds: F £ SHk (Xr„i) if, and only if, the kernel cp appearing 
in its representation Q satisfies the degeneracy condition 

E [tp (X [fe] ) | X [2)jb] ] = 0, a.s.-P. (4) 

When a [/-statistic F as in is such that verifies Q, one says that F is a completely degenerate 
symmetric [/-statistic of order k, and that ip is a completely degenerate symmetric kernel of order fc. 
For instance, when fc = 3, one has Xbh = (X2, X3), and condition becomes: 

E[(^(A 1 ,A 2 ,A 3 ) I X 2 ,A 3 ] =0. 
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Of course, by exchangeability, Q holds if, and only if, E \<p (Xrw) | X[fe_i]l = 0, a.s.-P. 

For every infinite non-deterministic exchangeable sequence X[ loo ) (not necessarily Hocffding decom- 
posable) and every k > 1, the class of all kernels <p : D k \— > 5ft, such that (@J is verified, is noted 

It is well known (see e.g. Hoeffding [1948], Hajek [1968] or Karlin and Rinott [1983]) that each i.i.d. 
sequence is decomposable in the sense of Definition A. In Peccati [2004], the second author established a 
complete characterization of Hoeffding decomposable sequences (with values in arbitrary Polish spaces), 
in terms of weak independence. To introduce this concept, we need some more notation. Fix n > 2, and 
consider a symmetric function T € S(D n ). We define the function P^^n-i as the unique application 
from D n - X to 5ft such that 

[Tt,n-\ (X[2,n]) = E ( T ( X N) I X M) . a.s.-P. (5) 

For instance, if n = 2, then X [2] = (X 1: X 2 ), X [2i2 ] = A 2 and [T]^\ (X 2 ) = E(T(X 1 ,X 2 ) \ A 2 ). Note 
that the exchangeability assumption and the symmetry of T imply that the application D™ -1 5ft : x 

( x ) is symmetric. Also, with this notation, T £ H„ (X [l oo )) if, and only if, [T]^~^\ (X[ 2 ,„]) = 0, 

a.s.-P. 

Analogously, for u = 2, ...,n we define the function [T]|™„"i : D 71 ^ 1 i— > 5ft through the relation: 

[ T fc-1 (X[«+i,th-»-i]) = E (T (X [n] ) | X^!,^!,) , a.s,P. (6) 

To understand our notation, observe that, for u = 2, n, the two sets [n] and [u + 1, u + n — 1] have 
exactly n — u elements in common. For instance, if n = 3 and u = 2, then [u + 1, u + n — 1] = {3, 4}, 
and [T]^ (A3, A4) = E (T (Ai, A 2 , A3) | A3, A4). Again, exchangeability and symmetry yield that the 
function x 1— v [T]„L _ 1 (x) (corresponding to the case u = n) is symmetric on Z)" -1 . On the other hand, 
for u = 2,...,n— 1, the application (xi, x„_i) [T]^" n (xi, x n -i) is (separately) symmetric in 
the variables (xi, i n _„) and (x„_ u+ i, x„_i), and not necessarily symmetric as a function on I?" -1 . 

When w = 2, n — 1, we note [T] n n _ 1 the canonical symmctrization of [T]„ n _j. 
Finally, for w — 2, set 

S n ,„_„ (X [li00) ) 4 It e S (£>") : [T] n>n _ 1 (X^+i,^!]) - 0, a.s.-P j (7) 

(recall that S (D n ) denotes the class of symmetric functions on D n ). Note that, by exchangeability, 

(n— u) (n—u) 

[ T \n,n-i ( X [«+i,«+«-i]) = °> a - s -- p > if > and onl y if ' [ T Ln-i ( X [»-i]) = °> a - s -- p - The following technical 
definition is taken from Peccati [2004] . 

Definition B. The exchangeable sequence X[ l oo ) is weakly independent if, for every n > 2, 

n 

(X[ li00 )) C P) 5 n! „_„ (Xj!^)) . (8) 

In other words, X[ loo ) is weakly independent if, for every n > 2 and every T 6 S(D n ), the following 
implication holds: if [T]^~^ (X [ „_ 1] ) = 0, then [T]^ n _j (X[ n _!]) = for every u = 2, 

The next theorem, which is one of the main results of Peccati [2004] , shows that the notions of weak 
independence and Hoeffding decomposability are equivalent for infinite exchangeable sequences. 
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Theorem (Peccati [2004, Th. 6]). Suppose that the infinite exchangeable sequence Xn j00 ) is such 
that, for every n > 2, 

SH k (X [n] )^{0}, Vk = l,...,n. (9) 
Then, Xm )0O ) is Hoeffding decomposable if and only if, it is weakly independent. 

Remark. Condition © excludes for instance the case: X n — X\, for each n > 1. 

Note that Theorem also holds for exchangeable sequences with values in general Polish spaces. In 
Peccati [2004] Theorem has been used to show the following two facts: 

(Fl) There are infinite exchangeable sequences which are Hoeffding decomposable and not i.i.d., as for 
instance the Generalized Urn Sequences analyzed in Section 5 of Peccati [2004] . 

(F2) There exist infinite exchangeable sequences that are not Hoeffding decomposable. For instance, 
one can consider a {0, l}-valued exchangeable sequence , such that, conditioned on the real- 

ization of a random variable Y uniformly distributed on (0, e) (0 < e < 1), X^ * is composed of 
independent Bernoulli trials with random parameter Y. See Peccati [2004, p. 1807-1808] for more 
details. 

Although the combination of Theorem 0, (Fl) and (F2) gives several insights into the structure of 
Hoeffding decomposable sequences, the analysis contained in Peccati [2004] left open a crucial question: 
can one characterize the laws of Hoeffding decomposable sequences, in terms of their de Finetti repre- 
sentation as mixtures of i.i.d. sequences? In the following sections, we will provide a complete answer 
when D = {0, 1}, by proving that in this case the class of Hoeffding decomposable sequences contains 
exclusively i.i.d. and Polya sequences. The extension of our results to spaces D with more than two 
elements is an open problem. 



1.2 Main results 

For the rest of the paper, we will focus on the case D = {0, 1}. According to the de Finetti Theorem, in 
this case the exchangeability of Xm i<X3 j = {X n : n > 1} yields the existence of a probability measure 7 on 
[0, 1] such that, for every n > 1 and every vector (ji, ...,j n ) <E {0, 1}™, 

V{X 1 =j 1 ,...,X n =j n }= f s ^(l-0)"- s *" 7 (d0). (10) 

7 [0,1] 

The measure 7, appearing in (JTUJl, is called the de Finetti measure associated with X[ l oo ). In what 
follows, we shall systematically suppose that X[ l oo ) is non-deterministic, that is, that the support of the 
measure 7 is not contained in {0}U{1}. In particular, it is easy to prove that, when D = {0, 1}, condition 
(0 holds if, and only if, X[ l oo ) is non-deterministic. 

Definition C. The exchangeable sequence X[ l oo ) = {X n : n > 1} is called a Polya sequence if there 
exist two real numbers a, (3 > such that 

im = —^--J a - l {\~e) f) - 1 &e, (ii) 

B(pt,p) 

where 7 is the de Finetti measure associated to X[x )0O ) through formula (|1U|) . and 

B(a,/3)= / 9 a - 1 (1 - Of' 1 d0 
Jo 

is the usual Beta function. The numbers a and /3 are the parameters of the Polya sequence Xr 1)QO ). A 
random variable £, with values in [0, 1] and with law 7 as in (|llfl . is called a Beta random variable of 
parameters a and (3. 
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Classic references for the theory of Polya sequences are Blackwell [1973] and Blackwell and MacQueen 
[1973] (see also Pitman [1996, 2006] for a state of the art review). Thanks to Peccati [2004, Corollary 
9], we already know that Polya and i.i.d. sequences are Hoeffding decomposable. The next result, 
which is the main achievement of our paper, shows that those are the only exchangeable and Hoeffding 
decomposable sequences with values in {0, 1}. The proof is deferred to Section[3] 

Theorem 1 Let X[x i0o ) be a non- deterministic infinite exchangeable sequence of {0,1} -valued random 
variables. Then, the following two assertions are equivalent: 

1. Xn go) is Hoeffding decomposable; 

2. Xn .oo) * s either an i.i.d. sequence or a Polya sequence. 

In Section 2| we will discuss some connections between Theorem ^ and the concept of urn process, as 
defined in Hill et al. [1987]. 

Remarks. We state two projection formulae, concerning respectively i.i.d. and Polya sequences. 

(I) Let X[ liOC ) be an i.i.d. sequence with values in {0, 1}, and fix n > 2 and T £ L s (X[„j). Then, for 
k = 1, n, the projection of T on the fc-th Hoeffding space SHf~ (X[„j) , denoted by tt [T, SH^] , is 

k 

n[T,SH k ]=Y / (-^ a E [T-E(T)£ a l(X h ,...,X ja ). (12) 

a—l l<jl<"'<ia<n 

Formula (|12|l is classic (see e.g. Hoeffding [1948], or Vitale [1991]), and can be easily deduced by an 
application of the inclusion-exclusion principle. 

(II) Let X[ l oo ) be a Polya sequence of parameters a, (3 > 0, and fix n > 2 and T e L s (X[„j). Then, 
for k = 1, ...,n, the projection of T on the fc-th Hoeffding space associated with X[„] is of the form 

n[T,SH k ] =E^' a) E [T-E(T)ti(X n ,...,X Ja ). 

The explicit formulae describing the real coefficients On are given recursively in Peccati [2004, formula 
(23)]. For instance, when n = 3, then 

a+/3+l 
a+/3+2' 

(q+/3+l)(q+i3+4) _ a+J3+l 
(a+/3+3)(a+/3+2) a+/3+2 ' 
a+fJ+i 
a+P+2- 

The rest of the paper is organized as follows: in Section|5]we collect several technical results, leading to 
a new characterization of Hoeffding decomposability in terms of conditional probabilities (see Proposition 
0| below); the proof of Theorem ^ is contained in Section |3J in Section QJ a brief discussion is presented, 
relating Theorcmnwith several notions associated with {0, l}-valued exchangeable sequences. 

2 Ancillary lemmas 

From now on, Xn )00 ) = {X n : n > 1} will be a non-deterministic exchangeable sequence with values 
in D = {0,1}. For n > 2, we write £({0,1}™) to indicate the vector space of symmetric functions 
on {0,1}™, while & n stands for the group of permutations of the set [n] = {l,...,n}. Given a vector 
x n = (xi, x n ) € {0,1}™ and a permutation tt G 6 n , we note Xn-/ n ) the action of tt on x n , that is, 
x 7r („) = (x^m, ...,i r („)). By exchangeability, we have of course that 

P (X w = x„) = P (X w - x, (n) ) , Vn > 2, Vtt e 6„, 
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yielding that, for n > 2, the value of the probability P (Xr n i = x„) depends exclusively on n and on the 
number of zeros contained in the vector x„. For n > 1 and j — 0, ...,n, we shall denote by P„ (0^) 
the common value taken by the quantity P (Xr n i = x„) for all x„ = (xi, x n ) G {0, 1}™ such that x n 
contains exactly j zeros. For instance, when n = 3 and j = 1, one has that P 3 (0^) = P (X[ 3 j = (0, 1, 1)) 
= P (X [3] = (1,0, 1)) = P (X [3] = (1, 1,0)). Note that, since X [1)0o) is non-deterministic, P„ (0^) > for 
every n > 1 and every j = 0, n. Analogously, for every n > 2, every j = 0, n, and every symmetric 
function ip G 5 ({0,1}™), we will write ip (O")) to indicate the common value taken by (/?(x n ) for all 
x n G {0, 1}™ containing exactly j zeros. 

The following result gives a complete characterization of the spaces 

(X[ l!00 )) , n > 2, 

defined through relation (0J (note that, to define the spaces 5„ we do not need Xr liDO ) to be Hoeffding 
decomposable). 

Lemma 2 With the assumptions and notation of this section, the set 2 n (X[ loo )) is the 1- dimensional 
vector space spanned by the symmetric kernel <pn : {0, 1}™ i—> 5ft defined by 

^K'H-^sfSy. * -■>•-"■ < 13 » 

Proof. Consider G S„ (X[ loo )) . By the definition of S„ (X[ l oo )), for any fixed j = 0, ...,n — 1 
and any fixed x„_i G {0, 1}" 1 such that Y^i=i (1 — x ') = h we have 

= E [ip n (X [n] ) I X [2>n ] = X„_i] 

- „ ro» +i ^ Pn (Q(j+1)) i y ro^ Pn(o0)) 

- M° Jp^o^+M Jp^oO'))' 

and therefore ip n (0^ +1 ') = — (P„ (0®) /P„ (0^ +1 ^)) x tp n (O^) . Arguing recursively on j, one has 

^ - i^|Sy ^ (° (0) ) - * = °> » - ^ 14 ) 

showing that any symmetric kernel v? n G S n (X[ l oo j) is completely determined by the quantity y>„ (O^ -*). 
Now define a kernel <^ 0) G S„ (X [litx)) ) by using d and by setting <^ 0) (0<°>) = P„ (0<°>) /P„ (Q(°>) = 1. 
It is easily seen that ip^ must coincide with the function defined in To conclude, consider another 

element ip n of S n (X[ loo )). Since there exists a constant if G 5ft such that ip n (0^) = K = Kipn (0*- -*), 
and since y n has to satisfy l|14[l . we deduce that (p n — Kifn \ thus completing the proof. ■ 

Given a function / : {0, l}™ 1 — ► 5ft, we note / its canonical symmetrization, that is: for every x m G 
{0,l} m 

/ ( x »o = ^ £ / K (m) ) . 

The following result will prove very useful. 

Lemma 3 Fix m > 2 and v G {1, ...,m — 1} and Zet i/ie application 

fv,m-v ■ {0, 1}™ i ^ 5ft : ( 

6e separately symmetric in the variables (x\, ...,x v ) and (x„+i, ...,x m ) (and not necessarily symmetric as 
a function on {0, l} m J- Then, for any x m = (x\, x m ) G {0, l} m such that 53j=i (1 — x i) = z / or som ^ 
z = 0, m, 

T , s _ Z)fc=0V(^-(m-i;)) (fc)(T-fc )fv,rn~v (0 (fc) , (z ~ fc) ) 

Jv,m-v (X m J — ^zAu /ii\/m-i\ ' 

2j/s=0V(z-(m-t))) VfcAz-fc/ 
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where fv,m-v (0^,0^ ^) denotes the common value of f v ,m-v (ym) when y m — (j/i, ...,y m ) is such that 
the vector (j/i, ■ ■■,y v ) contains exactly k zeros, and the vector (y v +i, ■■■,ym) contains exactly (z — k) zeros. 
As a consequence, f v ,m-v (x m ) = for every x m G {0, l}™ 1 if, and only if, for all z — 0, m, 

/c=0V(z-(m-u)) v 7 v 7 

Proof. Fix x m G {0,l} m such that = z f° r some z = 0, ...,m. Without loss of 

generality, we can assume 

x m = (0,0, 0, 1, 1, 1). 

z times rci — z times 

Observe that, for all k = max {0, z — (m — v)} , min {z, v} , there are exactly z\ (m — ) P er ~ 

mutations 7r G 6 m such that 2j=i (l — = ^ an< ^ Ej= B +i (l — x v(j)) = z — k. The set of all such 

permutations will be denoted by 6m • It is immediately seen that 



fv,m — v ( x m) — | ^ ^ ^ ^ fv,m—v \ 0^ ^ ^ 

fc=0V(2-(m-u)) TreS^' 

= ^ £ / 1) , m ^(0W,0^)xcard(6( n fe) ) 

fc=0V(2-(m-u)) 

Formula l|15(l now follows by observing that 



v \ i m — v 



. . = y 

z\ (m — z)\ \z) \kj\z~k 

K ' v 7 fc=0V(z-(m-ti)) \ / \ 

The last assertion in the statement of this lemma is an easy consequence of <|15|) . ■ 

We shall conclude the section by obtaining a full characterization of {0, l}-valued Hoeffding decom- 
posable sequences (stated in Proposition 0] below). 

To do this, recall that, for any symmetric (p : {0,1} h- > K, every u = 2,...,n and every x„_i G 

{o,i}"-\ 

Mi"n-1 ( x «-l) = E {V ( X [n]) I ^[u+Uu+n-1] = Xn-l) ■ 

Observe that the function [^^"""J : {0, 1}™ 1 i— > 5ft clearly meets the symmetry properties of Lemma |3 
with m = n — 1 and v = n — u. Now fix z G {0, n — 1}, and suppose that x n _i G {0, 1}™ 1 is such that 
J2jZi 0-~Xj)=z and J2]=i i 1 ~ x j) = k - Then, 

bUM=Lyn tf ) p n _ l( ow) • (17) 



__ -(n — u) 

By applying (|16(1 in the case m = n — 1 and v = n — u, we deduce that [y?] n n-1 (0 (z >) = if, and only if, 

T 1 (v)(::>ti(° w .°<*->>H. < i8 > 

fc=0V(*-(u-l)) v 7 v 7 

where the notation [ip] n _\ (0 1 - 2 ') and [<y£>]|" rl _"i (0^,0^ -fc ') has been introduced to indicate the value of 
Ml,™-! (y«-i) ( res P- Mi"^-i ( w n-i)), where y„_ x = {y x , ...,y n -i) G {0, l}"^ 1 is any vector containing 
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exactly z zeros (resp. w n _i = (w\, w„-i) G {0,1}" 1 is any vector containing exactly k zeros in 
(wi, ...,w n - u ) and z-k zeros in (iu n _ u+1 , w„_i)). 

Now recall that, by Theorem 0, X[ l oo ) is Hoeffding decomposable if, and only if, it is weakly indepen- 
dent, and that X[ loo ) is weakly independent if, and only if, for all n > 2 and for any ip £ S n (X[ loo )), one 
has (p 6 S n tl (X[ l oo )) for all u = 2, ...,n. By Lemma|21 we deduce that the sequence X[ ljOC ) is Hoeffding 

decomposable if, and only if, for every n > 2 and every u = 2, ...,n, (p^ - 1 G S„ iU (Xr liQO )), where t^ ' is 
defined in ljT3|) . By ljT%|) . this last relation is true if, and only if, for every n > 2, every z = 0, ...,n — 1 
and every u — 2, ...,n, 



zA(n— 



£ rr)(:::)wr:(^- 4 ')- <-» 



n — u\ /u — 1 

I 

fc=0V(z-(«-l)) 

Substituting (|13|l and (|17|) in (|18|) . we obtain that l|19|) is true if, and only if, 



T <-<r)(I-> 

" 1 V" / fe=0V(z-(u-l)) v 7 v 7 



Note that 



x 

m— 



to/ P„ (0( m+fe )) 

n-l+u (0(" 1+Z )) _ 1 



where P^+u-i (0( m+z * > | o' m+fc - ) ) denotes the conditional probability that the vector ^[n+u-i] contains 
exactly m + z zeros, given that the subvector X[ n ] contains exactly m + k zeros. 

Remark. For every n > 1, < a < b, every v > 1, the quantity P™ + ^ (0^ | 0^) is equal to 
P(X[ n+l n+t ,] contains exactly b — a zeros | X[„] contains exactly a zeros). 



By plugging (|21|l into H2U|) . we obtain the announced characterization of weak independence. 

Proposition 4 Let X[i -00 ) &e a non- deterministic infinite sequence of exchangeable {0, lj-wa/werf random 
variables. For Xn i00 ) to 6e Hoeffding decomposable, it is necessary and sufficient that, for every n > 2, 
evert/ m = 2, n and every z = 0, ...,n — 1, 

zA(n—u) 

0= £ (-l) fe 

fc=0V(z-(u-l)) 

xE(-ir(")pn +u -i(o (m+2) io( m+fc) ) 

m=0 ^ 7 

As shown in the next section, Proposition 0] is the key tool to prove Theorem ^ 



( n — u\ 



3 Proof of Theorem [T] 

Here is an outline of the proof. We already know (thanks to Peccati [2004, Corollary 9]) that, if X[ loo ) 
is either i.i.d. or Polya, then it is also Hoeffding decomposable, thus proving the implication 2 =>■ 1. 
We shall therefore show that Hoeffding decomposability implies necessarily that X[ l oo ) is either i.i.d. 
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or Polya. The proof of this last implication is divided in four steps. By using some easy remarks (Step 
1) and Proposition 0] we will prove that (|22|l implies a universal relation linking the moments of the 
de Finetti measure 7 underlying any Hoeffding decomposable exchangeable sequence (Step 2). After a 
discussion concerning the moments of Beta random variables (Step 3), we conclude the proof in Step 4. 

Step 1. We start with an easy remark. Define 

S^{(x,y,z):0<x<y<z<l}, (23) 

as well as the two functions 

/ (x, y, z) — 2x 2 z — xy 2 — x 2 y, and (24) 
g(x,y,z) = zx-2y 2 + yz. (25) 

Then, for any (x, y,z) G S one cannot have / (x, y, z) = and g (x, y, z) = simultaneously. 

Step 2. Let Xrx ,oo) = {X n : n > 1} be a non-deterministic exchangeable sequence with values in 
{0,1}, and let 7 be the de Finetti measure uniquely associated to X[ l oo ) through formula (|10() . We 
denote by 

Mn = Mn(7)= / 0™7(d0), n>0, (26) 
J[o,i] 

the sequence of moments of 7 (the dependence on 7 is dropped when there is no risk of confusion). We 
shall prove the following statement: if X[ ljOC ) is Hoeffding decomposable, then 

) = / (A*n,A*n-l)Mn-2) , n > 2, (27) 

where f and g are respectively defined by \24\) and ^<15\) . 

To prove ijTHl . first recall that, due to Proposition^] if Xr 1)OC ) is Hoeffding decomposable, then formula 
(|22|l must hold for every n > 2, every u = 2, n and every z = 0, n — 1. In particular, it has to hold 
true for u = 2, i.e., for all n > 2 and all 2 = 0, n — 1, one must have that 

E (-!) fe V E ( - 1)m U n+l (° (m+2) 1 ° {m+k) ) = °' (28) 

fe=0V(z-l) ^ ' ™=0 ^ ' 

for every n > 2 and every z = 0, n — 1. For z = 0, formula (|28|l becomes 

(o (2) I (2) ) - 2P£ +1 (o (1) I (1) ) + P™ +1 (o (0) I (0) ) = 0. (29) 
For z = n — 1, l|28|l is equivalent to 

K+i (o (n) I o (n) ) - 2P£ +1 (o^ -1 ) 1 o ( "- 1} ) + p™ +1 (o (n ~ 2) 1 o (,l ~ 2) ) = 0. (30) 

For 1 < z < n - 2, J2EJ) becomes 

= (":J)k +1 (o (z+2) |o (z+1) ) (31) 

- 2P£ +1 (0 (2+1) I (2) ) + P£ +1 (o (z) I 0<* -1 >)] 

-f n ~ 2 )r +1 (o (2+2) 1 o (2+2) ) 

- 2p;j +1 (o (2+1) 1 o (2+1) ) +p™ +1 (o (2) 1 o (2) )]. 
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Combining (|29[1 . (|3U|) and we deduce that (|28|) is true if, and only if, for all p = 0, n — 2, 

P£ +1 (V p+2) | (p+2) ) - 2P™ +1 | (p+1) ) + P£ +1 (0 (p) | (p) ) = 0. (32) 

Now, for p = 0, — 2, write A p to indicate the (forward) difference operator of order p, given by: 
Ao/(n) = /(n),Ai/(n)=/(n + l)-/(n),and 

A p = Ai o • ■ • o Ai. 



p times 



For p — 0, n — 2 one has 



K+i (0 (p) I (p) ) - K+i (Xn+i = 1 I X [n] contains p zeros) 

_ ^pf-^n-\-l—p 

where the sequence of moments fi n , n > 1, is given by (|26|) . Since must hold for p = 0, we deduce 
that 

A 2 /i n -i _ 2 A 

A2/i n -2 Ai/i n _i /!„ 

and straightforward calculations yield relation (|27H . 

Remark. Suppose that X[i i00 ) is exchangeable and non-deterministic, and define fj, n , n > 0, via 
(|26|l . Then, we have that G (0, 1) for every n > 0, and that, for every n > 2, (/x„, (J, n —i, Hn-2) € 5*, 

where 5 is defined as in l|23l) . As a consequence, the conclusions of Step 1 and l|27l) imply that, if Xn )0O ) 
is Hoeffding decomposable, then / (/x n , // n _i, fXn—2) 7^ and g (//„, 7^ f° r every n > 2. 

Therefore, 

_ / (/"m Mn-lj Mn-2) ,„„,. 

Mn+i — — p r ■ (.ooj 

Step 3. We claim that, for any (ci,ca) G (0, l) 2 such that c 2 < c 2 < c\, there exists a unique pair 
(ar*,/3*) G (0,+oo) x (0, +00) such that 

E[£] = ci and E [£ 2 ] = c 2 , 

where £ is a Beta random variable of parameters a* and (3* . To check this, just observe that, if £ is Beta 
of parameters a and /3 then 

„ a , „ /j, a (a + 1) 

E (£) = and E (£ 2 ) = \ ' -, 

and that, for every fixed (ci, C2) G (0, l) 2 such that c\ < c 2 < c\, the system 

' ci 

+1: 

(a+/3)(a+/J+l) 

admits a unique solution (a*, (3*) G (0, +00) x (0, +00): namely 



q(q+l) _ 5 (34) 
^2 



,,* _ gi(l— gg) 



o* _ (l-c 1 ) 1 (c 1 -c 2 ) ( 35 ) 
P — ^T72 



C2 — Cf 
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We are now in a position to conclude the proof of the implication 1 2 in the statement of Theorem 

□ 

Step 4. Let Xm )0 o) De a non-deterministic exchangeable sequence, denote by 7 its de Finetti measure 
and by {fi n (7) : n > 0} the sequence of moments appearing in (|2lj|l . We suppose that X[i iOQ ) is Hoeffding 
decomposable. There are only two possible cases: either [i\ (j) 2 = ^,2 (7), or /ii (-f) 2 < /i 2 (7)- If 
Mi (7) = (7)7 then necessarily 7 = S x for some x G (0, 1), and therefore Xh ^ is a sequence of 
i.i.d. Bernoulli trials with common parameter equal to x. If /ii ("f) 2 < /i 2 (7), then, thanks to the results 
contained in Step 3 (note that /x 2 (7) < A*i (7)1 since X[ loo ) is non-deterministic), there exists a unique 
pair {a*, f3*) e (0, +00) x (0, +00) such that 

Mr (7) = m) = w ^ m f Q ee*'-Hi-ef-Ue (36) 
M2 ( 7 ) = E(e) = B{a l^ ) j\ 2 e-'-Hi-of- 1 de, (37) 

where £ stands for a Beta random variable of parameters a* and (3* . Moreover, l-i-'il) and the fact that 
Polya sequences are Hoeffding decomposable imply that, for any n > 2, 

, s f fan {l) , (l) , (l)) , 

Mn+i (7) = —7 r~\ TTT' and 

9{fJ-n (7),Mn-l (7) ,Mn-2 (7)) 

^ j . 9 (E(e),E(e- 1 ),E(e- 2 )) ' 

where / and g are given by l|24|) and l|25|) . As l|36|l and l|37|) are in order, we deduce that, for every n > 1, 

Mn ( 7 )=E(e)= — i / 1 W*- 1 (l-<*" 1 d0. (38) 
B(a*,/3*) J 

Since probability measures on [0, 1] are determined by their moments, the combination of l|36(l . 1371) and 
(j2Hl gives 

7 (d#) = - 1 - , f'-' (i - ef*- 1 de, 

,y ' B(a*,/3*) K ' 
implying that X[! ^ is a Polya sequence of parameters a* and /3*. This concludes the proof of Theorem 
□ 



4 Further remarks 

(I) With the terminology of Hill et al. [1987], a random sequence X[ l oo j = {X n : n > 1}, with values in 
{0, 1}, is called an urn process if there exists a measurable function / : [0, 1] ^ [0, 1] and positive natural 
numbers r, b > 0, such that, for every n > 1, 

P(X„ +1 = 1 | X x ,...,X n ) = f f r + Xl + 7 +X " N ) . (39) 

According to Theorem 1 in Hill et al. [1987], the only exchangeable and non-deterministic urn processes 
are i.i.d. and Polya sequences with integer parameters (for which / is, respectively, constant and equal 
to the identity map) . This yields immediately the following consequence of Theorem ^ showing that 
the two (seemingly unrelated) notions of urn process and Hoeffding decomposable sequence are in many 
cases equivalent. The proof can be achieved by using the calculations performed in Step 4. 

Corollary 5 Let X[ l oo ) = {X n : n > 1} be a {0, l}-valued infinite exchangeable non- deterministic se- 
quence such that 

P (Ai = 1) = ci and P (Ai = X 2 = 1) = c 2 , (40) 
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for some constants c\ and ci such that < c\ < C2 < Ci < 1. If the system \34\l admits integer solutions, 
then X[ l oo ) is Hoeffding decomposable if, and only if, it is an urn process. 

In general, a sequence X[! ^ verifying is Hoeffding decomposable if, and only if, it is a Polya 
sequence with parameters a* and (3* given bu if#5|) . 



(II) The arguments rehearsed in the proof of Theorem ^ provide an alternative proof of Theorem 5 
in Diaconis and Ylvisaker [1979]. Indeed, in this reference it is shown that, if an exchangeable sequence 
is such that its predictive probabilities 

P"+i (0 {p) I (?,) ) = P (X n+1 = 1 I X w contains exactly p zeros) 

depend linearly on p, then its de Finetti measure must be Beta or Dirac. To see how Diaconis and 
Ylvisaker's result can be recovered using our techniques, suppose that a given exchangeable random 
sequence is not i.i.d. and is such that its predictive probabilities verify the equation 

K+i(0 {p) |0 (p) ) =a nP + b n (41) 

for some positive sequences {a n } and {b n }. Then, it is immediately seen that P™ +1 (0 (rt I (p) ) also 
verifies (I32[) . and one deduces from the previous discussion that the associated de Finetti measure must 
be Beta. Conversely, if one supposes that the predictive probabilities P^ +1 (0^ | 0^) of an exchangeable 
non-i.i.d. sequence verify the difference equation l|32(l . then one must conclude that the P™ +1 (0^ | 0^) 
verifies l|41ll and that 

o n = and b n — ; -, 

l + a(n-l) l + a(n-l) 

for some a > 0, b > such that a + b < 1. 

Acknowledgement. Both authors wish to thank Igor Prunster for inspiring discussions as this work 
progressed. 
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